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(54) VIDEO MONITOR DEVICE 

(57)Abstract: 

PROBLEM TO BE SOLVED: To obtain a virtual video monitor 
system which composes a monitored body pickup image from a 
desired virtual viewpoint on a plane. 

SOLUTION: Image recognition parts 2 (for example, A, B and C) 
recognize a monitored body from respective image pickup image 
data obtained by monitor cameras 1 (for example, A, B and C) to 
detect the corresponding position coordinates. A plane 
specification part 3 sets the desired virtual viewpoint on the plane 
specified with three point positions of the respective monitor 
cameras 1 through an input part 4 and a plane distance arithmetic 
part 5 extracts the respective plane distances of the respective 
monitor camera positions to the desired virtual viewpoint on the 
plane. A plane virtual interpolation image composition part 6 
repeats an image interpolating process for weighting the respective 
monitored body position coordinates from the image recognition 
part 2 by the respective plane distances from the plane distance 
arithmetic part 5, and puts together and displays the plane virtual 
interpolated images at an image display part 7. 
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[0041] 

As shown in Fig. 10, in the image monitors of another embodiment of 
the present invention, the observation camera A 31, B 31, C 31and D 31 
observe part of the entire area to be monitored. The moving object 
recognition unit A 32, B 32, C 32 and D 32 recognize a moving object to 
be monitored through the image data of the observation camera A 31, 
B 31, C 31 and D 31, and identify its position and direction. The image 
data receiver/transmitter A 33, B 33, C 33 and D 33 receive the image 
data from the observation camera A 31 B 31, C 31 and D 31 via the 
image data receiving and transmitting control unit 37 and display the 
image data on the image display unit 38. The monitored object 
traveling direction transmitter A 34, B 34, C 34 and D 34 judge whether 
the object to be monitored is located within an imageable area based on 
the present position and traveling direction information from the 
moving object recognition unit A 32, B 32, C 32 and D 32. If the object 
is located outside of the imageable area, the monitored object traveling 
direction transmitter A 34, B 34, C 34 and D 34 send notification to the 
adjacent monitored object traveling information receiver A 35, B 35, C 
35 or D 35 in the traveling direction of the monitored object via the 
communication line 36. As the monitored object traveling direction 
information receiver A 35, B 35, C 35 and D 35 receive such notification, 
when the object to be monitored enters the imageable area, the 
receiver A 35, B 35, C 35 and D 35 send such information to the 
receiving and transmitting control unit 37 via the communication line. 
The above-mentioned consecutive operations allow a wide range of 
monitoring and autonomously coordinated load distribution. Needless 
to say, movable cameras with movable mechanism such as zoom, pan 
and tilt are available as observation cameras. 

[0042] 

The image monitor in the above-mentioned embodiment allows a wide 
range of monitoring in communication between experiments multiply 
located on the network and employs a method to perform load 
distribution by autonomous cooperative operation and monitor images 



(the autonomous cooperative distribution image monitoring method) 
[0043] 

As shown in FIG. 10, the image data receiver/transmitter A 33, B 33, C 
33 and D 33 as well as the monitored object traveling direction 
information transmitter A 34, B 34, C 34 and D 34 and the monitored 
object traveling direction information receiver A 35, B 35, C 35 and D 35 
operate as follows. For example, as an object to be monitored is 
moving to the right, the image data receiver/transmitter B 33 receives 
image data from the observation camera B 31 that is located within the 
imageable area and displays the image on the image display unit 38 via 
the image data receiving and transmitting control unit 37. In the case 
that an object to be monitored moves to the right and is expected to be 
out of the imageable area of the observation camera C 31, the 
information of the present position and traveling direction of the object 
to be monitored is transmitted from the monitored object traveling 
direction information transmitter B 34 to the monitored object traveling 
direction information receiver C 35 via the communication line 36. 
Then, the image data receiver/transmitter C 33 receives the image data 
from the observation camera C 31 that is located in the imageable area 
on the right direction of B and displays the image on the image display 
unit 38 via the image data receiving and transmitting control unit 37. 



FIG.10 

fa^U^fc : Object to be monitored 

WLM% * 7 : Observation camera 

: &W) ! $sWWM.1& A : Moving object recognition unit A 

&W]%»fcW&ffl> B : Moving object recognition unit B 

&Wi%WMWM C : Moving object recognition unit C 

^WitfafoWMM D : Moving object recognition unit D 

mmmmf-tm^itm a : 

Image data receiver/transmitter A 

mmm&T-?m§:mm b : 

Image data receiver/transmitter B 

m&wf&^—fmstism c : 

Image data receiver/transmitter C 

WLi*.mi&7 s —?m&iam d : 

Image data receiver/transmitter D 

Monitored object traveling direction information transmitter A 
Monitored object traveling direction information transmitter B 
Monitored object traveling direction information transmitter C 
Monitored object traveling direction information transmitter D 

Monitored object traveling direction information receiver A 

«£#«B(*5ifT:frlS]ffi«£f3« B : 

Monitored object traveling direction information receiver B 

mmmwwirtJifam n^mm c : 

Monitored object traveling direction information receiver C 

^mi^mn^^mm^m m d : 

Monitored object traveling direction information receiver D 
il-fs®^ : Communication line 

Image data receiving and transmitting control unit 
M'fe^^pfl : Image display unit 
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Bto x-mmi'mftzmmLmmw.mmzmiii-f 

tsm^am 6 xmmmu 2 <o&w.mm&<m 
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¥®*#5gS? k . Wt^t h A?) <T> I5l2¥ffi«f 

Tit 5t-r ^Tffi±^M«5Sffi.*.tc«~r * B?ie 3 su± 

OS-*;* 7&ak W^SK^^tttK-t-STaSE^ff 

set , «EB*Bssfflt*»4>oaa*«FaAfci* tMie^F- 

^k£fi|;t6l!*&g£J5l§£a. 

[IS:£-fl2] |a]t^®±t;:&&3£ia±cO#.X7k|5] 
& .X 7 k £il 9 — SS£J£ * * k ^Fffi^F SeS5T' 

SEStiSimSBk . BuieBmi2ilS5*^OSIS»*i:¥ffi 

i egffl&M.m%mfr h <r>^mnnm& iz x & s*-?it 

Wg»iFt><w&&fi 18<£Bfife k cvmfrZm 9 n§isitt2rifij 
ffr££-f& 3<£7c7'7 7 -r •/ ?Mfe£j£SBk . i£3 &7C 

^7 7-fV^B^^*^«03^7C^5 7-f 7?1I 

k Tffl^«|BBi«^J«9*» ^<?53gft«H«f tt^ffllR 

mim 3 te^Bfci&smisa. 
[ li^js 6 ] ^aiffl w&^w z mm-r h 



IB-C«*-r4i6ffi*^ 5 SUSS? k 

a. 
a. 

mmmmm * ax 0 a^B^^^T-i^n-r & iks* ^ 9 
s^a. 

tmmm<om&&.m t wn-fi^mm^tss.-f & mm.<r> 
mfieif »<o ^^^T&^sisa^B^^axo a^B^^ 

«jfW(*««^riai6Hrt t=Ao t < s k . MieS«IB«T 
- ^Jigft^J WSSCiWlUlll $r it L -e^^ 5: & & 
SScO^^ffi^ftsjttfir^rfSlW^SfS^k Srfiii. i»B*^ffi 

sa. 

[ i o ] m.mt *7/-tyr<,z£& A7J w^a^ 

JftSfeffftfifS** 6 ^> Sfefrfflfefc k Hut a A^) ti!S8M 

k. K^iMS^^tfJflBKiSfcrlK^BaSSSKJ* 
H?KSS^^9*^BX0jitfS^B^jMft$:^ 

Bfcfl&iassia. 

[»*Ji i 2 ] mmm^imm^x-yo >a- h-t 
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1 1 £!E*)iKtttttt£gC 
[000 1] 

[0002] 

[ft*c9&'f«] fc t itfltBHTS - 3 3 4 5 7 
fc*^-fi£*^i««Sa«6S«S 1 2<7>J: 3C. 
75111 a5Jl(*ia5^Hs&llS«HTT'^B$»^*-r 
4. Jut** 5 5 1 a(i. Siftg^fls (ffA#=Srfc') £ 

ajar*- s t zco&mizm t , ?n»:gi5 5 2 5 3 

(clO. I¥»5r»a (Affi&i:') MflSioCrt 
MX- 5 y^-^fiUlift^ U »£ffiftfle£iK l > 

izimizmttziii;±m&<?>mm$:-fz. 1*352(1 

tt-Th. 8B«5 5tt, S^tieJ1^^7 5 1*^5 
£ fcfc t * Ji'-flK K*t«3tW>8SiW- 5 ( £ 

i8SiLS3«ffiii«aja. B«Ma+isiB«*£jaw-&:fr 
tit ytt&m^E.nmmx^mnwnstttim.*? 

[0003] ±IEfitfW>i*«iSHJ6»i. mkthWK 
[0004] 

[0005] ^^^h^m^lj: 9 t-thwmit. mk 
&iz*i l . ®*$M*fr h cr>mmz x & s^-?tt * l ^js 



( 2 > &®*x t>ti&&WT'&tiK®$mm# 

( 3 ) *y h7-^±t«REIlS-t4«jil*iaaMS-C 
[000 6] 

[0007] mmimmi. m t^m±izh & 3 

i^Uiq tW-m±lzh h 3 Stub*)** 7 1 la) t¥ffi± 

[0008] ^-mn^mi. m t ¥m±.iz$> h 3 
[0009] ^-m&MMmmt. m^thx^m^ 

£«, L<ittmmmmijmm£Lizm-hmt¥w±.izfr 
[ooio] ¥ffi{R®«faB«^-«gi5{i. wMmmfr 

[0011] ¥ffi^t#«gPfS. IS«-r^A7J¥K*^ 

5 h *m *) -mz$i& h-mmt^mw^rnxm^-th 
'mtnjz&b tx*?-m±.<7)wm%ij££ttm3imz 

[0012] siasEjaijii^gfti. ¥Ba*#^*^<o 

[0013] Qfflm&mfflMm-s&Lmj.. wmmmmfr 
¥s<si@a^]Bm^^*^i0¥ffl(5««ra 

[0014] jfefrBttfiftftK*. #X/^< 5*»^>»»3atr 

=s-a^B^^«-5tffa^B^h LT-^R^^-r^.. 

[00 1 5 3 ^bSfflfg^i, ^^^JROJiO 
fc^)^*l5lO««Sltt*-|ai<z««tlEll*1*je-r*. 
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[00 16] 3#7C?7 7 4 •y?B«£jfcaKi. 
&A^SA>^¥®±c0<5SJl*J;: J: &*If?BtiU;:# 
L , ft&&*0> 3 &7CT- 9 TUffiftft 

[0017] 3<*C7ae«B«R^J«»«. 3&7C?'7 7 -f 
•y ?Bi&^S5#^t03»:7C?'5 7 -f >y 7Bt£i:¥®M 

[0018] fljflcGMrajeaui. 
-t-i>/a^^ ^^^ixoatf^a^Bffi^R*^* 

[0019] aaa* 1*tt{&WB5e»a»fc 

J*l*](c£>6 1 &l2U:«>*riWMt* toiSSA^ 
oytTOMr.* 7*l»¥ST»ffl6i|»S:-r4iSffl«*B 
[0020] (RS*;* 5SWg|C(£* j£*g#p< 7©JffllSPtc 

^ 3 zm^r . ««*iisiB«^j«#S"ctBea«i 

fcLT^iS£^S[R^«»«B«£SX9ii*. B«H 
[002 1] 9«i«fflEi83KSKU. SRifttt, ttMMEM 

[0022] ««B*T-^SS<i«li» «Rift«t. if 

[0023] tjaemflrttcjmt^riftiflHiBsmsJi. 

[0024] «K««i«cjlttf*|6l««Sm«tt. 

35EfiMmKcaeiini£4- ^z^itwmh. 

[0025] A*tiH8HUlSK±. EH** ^/-fc^K: 
J:4A*^0»&WfHm«**f»t£ttaJ-*-4. 

[0026] mmmmiftmftmt. wmatoMtzt 



[0027] i*ftra*^frffi^gp*^# 

S^4^¥^kA*flHB^»^4.0»fSK«flH8 
tOJttKFB*"*-*. 

[0028] SMfiSHi, ^frSMBS^fe^aJIBHSftCtt 
[0029] 

ti. m t^-muzh o a^a*«s^»ft-r « . a t b t 

9 1 t «t h 3 *f4^T'^«-r^¥ag^^-r 
A^a54ti. ¥Bff#^a53T'^-r ^TiLkoBfa 
<rs«j££ h . v>>x-e^«i<oA*#a-csis 

U ¥BflE*K»*SI5 3fc:*rLTA:JrrS. ViOeJIflift 
SB5{±, A^J»4*»^<?5¥ffi±<0BfSBlR««jSfc:*«-4 

AtBtccTjiga^^^ifaBto^ffiffisi^ttai-r 
* . ¥®(SffiaraB«-^^a5 6 n s AtBtc <mms> 

B«ss^*7tt. Tffi{ssaraB^«a56*^^<s(c 

JEtTO«i«1iiaiB«S:**-*-4. TmhWBtaiRSS 

[0030] ±ie»feco»«£OB!)iiM^aga{i, aas^) 

[0031 1 ¥ffi{£S«fSM®-^«gB6(±!2 2 ( a ) cr> 

( x, „ y, ) t ( x 2 . y 2 ) t ( x 3 , 
y 3 ) fcU TffiSSH«SLSS5*^<7)Ai:BtCiOKtl 
*^7lt (S3®m*fc <7)#ffl«Sg^$: a.bbtcb-th 

(x. y) *<XOfc*J0JlcaiL. o**fc^iSaW*tBg 
tiktl *5@2 ( b ) £0 J: olzW-ffimmiSMmZ-ii 

x = (aXx, +bXx 2 +cxx 3 ) /3 
y=(ax y , +bXy 2 +cXy 3 ) /3 

[0032] ^r*3±ffiia i iz^-r^com^mmx-m 

3<r>Xol,z^ AtBbc<o%tt*?*y l tfflt¥miz% 
^mmtl* 7 lab. 3K»«B«T- 
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J5A\ ¥B«j£«£«3 a £ A7J354 a £2IS]££ft£ 
SB 5 a £ Sra(SS!ffl^H»^^.S5 6 a fc BttSl^SB 7 a 

mm£±m%t* y i at s-ao-stcs* 

£¥ffit#£353rt$^&¥ffi£«££ LT¥ffi±tfO 
St 1 *>ffi8B«£S: ftjg-T S . SISffiKBSB 5 aii. ¥ 

& atjsm ax«-r?»^ra±<7)» i commwgM&t 
mi**? i a{5atco#^rasgi§i*ttait-^. sras 

i®«fUSffi£i056 a«. BLISSES? 2 aj&»4>«0*£« 
9MMMUM £ TBiBBMnBfl&l&ai 6 *>£><7)¥ffi<£ 

saraa«kt=»L. sisimmuvsa^co^sia 

(00 3 33 &fc±£B 1 izifrtm&mH&eoBmTm 
4<D£z>lZ^ At B£ COftfiBBtel^S t, AhB 
£ C 0>£fc«raSNW 9 £ £ SiJi&ISf t , H 5 CO J: 5 tcT 
BBSBQBB S: ^« L X t> X i\ B«*>SHfc«ffl fc*»t 

•cwa<soB«»ia«yi#T# & . a £ b t c^ffii 

«Rflf»8ti. At Bi:C«g^7 1 (CJ: .g>#«BB 
Br- * K« L . A £ B £ C <7)HBf2I§SI5 2 TSBflUI 

A£B£CWSEflflEHi8SSaJ9tt, A£B£COB 

ffif§ssas2 *^A^j-ri»#^fi : ti^B«7 : -^ t AtB 

£ C cryftft BBteWSP 8 <0#jfefr»«B*r - * £ 
wH^^ffiO^lftfirffiJO^-fkKffl^^L, A£B£ 

fljaffl^t™R«aisiB«-&ifi* 6 ictb^-r & . 

[0034] *3t±IE04fc:Srr«W«?)|ltt<O»JIStr0 
60J:3tc. A:fcS4a»&<3¥ffi±^BSB««j5KJ: 
S «Sf B«(=*t L . ^y>ffr£S<7> 3 <5C7C-r- ? TJnBf^ 
3 (3D) 7 -f y ?B«£J«« 1 0 

t . 3 d 7? 7 -f y ? bb-t- ^ t ¥®{EsaraB 

B^JSSB 6 A^SMbffiH^'tt^^BiSS^BtKx- * 
fc«OBB£B£U 8£«B«(=*«-S3[Bffi03Di5ra« 
PrBB £ «D£Bt= J: h 3 Di£}f BB£4u£f-& 3 DE« 
bb^£b 1 1 1 zsmmtx t) J;^,, 3 D -f- 

[0035] £tz±.um i iz^i-^BM^mm^mmx'W- 

ffi±.cDrmmgM£.l,zittX , E376DJ: d tMBHHS: 
BSBjAiBBfr (x. y) s fflilJacmttl, 



tiUZi* (x-ffX^/2, y ) / (x+«x6>/ 

2. y) (©«ai£4fe«iE«ifc:j:sm) twc 

[0036] 3.£z±gffl4 £06 * *r<iH 7 K^-ffgBJl 

commcommum 1 Ks^fwitosgB^jBTBBaia 

4 t> L < ti[36 ic^f W91<?)nm(?>Bm<7)l,Zi)\ 2 
±cO^^< 5 A*"CBBtilBBaB*-rs-r^T<0«!«Ka 

[0037] zcr>muzffi&^-$>mt&<7>— mmtxitw 

®.m%gim±m8 (a)cr>£ol,Z. A£B£CcOJg«^ 

^52ia. «s{aa^>ai£«!BBs-aH»-f6. a£b 

OJSJ«^^7 2 1 a(i, «(c«BBiZ«^B$-BB'r 

A£B<0«lB<a{t^»2 2ti, A£B60j£iS^^< 
7 2 1 atJ:6«.t£«»«B«T-^*»^*lga«lBS: 

&. jfill^^5S«l»35 2 3{i, A£B«7)!Bj«cag^B 

t-e w i >t u^Mx-mmmw sr -r s a . b s fc« c <oa 

S^7 2 lJi^ifiSBBBB-r-^SrlROa^. iS^ 

*^5Bii^ai2 4T'^-r-i»„ -$7i/-Artc 

^ig L e«0^{cgM77 -X 1AeffiiBB ^BfiH L . 

[0038] ±£^Jfi<OJB®<Ott«B£^Bti. 
SKir £' SvFS £ L » S B»(c«iBfS4BBf^ ^ -f & 775^ 

[0039] ^fc±ie08 ( a ) \,z^wmmfc<n-- 

WMX'i&m**7 2 1 £i6«^^ ?Mttgff2 3^-ft^. 
t.08 (b) OidtcX-A, ^'>-, f-;Ph^r£'<?3^I 
KjS«5r^oifi^><7 (^J1!j#j<7) 2 1 b£, A£ 
BOfllBfl[B«^ffl2 2*^<7)^fiatSS(c:fiev\ 4 
-f 5Bj9?SiJ»*a-ce»i fc{i#»-CBjKB« 

f-/Ph5:if<OIW|5M«*t-SA, B47t«C<7«fiffi 

7Bft*^gB 2 4 T-*5K-r S jSS^^t 5$iJfflISI5 2 3 
a£LT««LTt>i^. — g7 U-AZlt Jc^igLi 
«WtcBB^^ 7tcJ: ^>©ii*ISO«^!fe«5^3SS» 

l. mtimftnmz&mx'Z & . 

[oo4o] ^7c±ien8 < a ) \.z^twmnm(r>~ 

BmX'i5Mti*7&lW&2 3<,z{t£X. m9<r>Xdl,ZA 

£ B<o«iB<aam^ffl 2 2*^c73«-#^{agtt$g 

«0<KS«,*A^c7)S^^*a®Bft ((KSffiraB®) 
£ LTBBfmSBMKc J: 0 -g-Rg-T l» <E«^M(iB{£x 

-^StK^j^ &m**7Mmmxk%ii2 4X'm*i-fz> 
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coo4i] ^<7)%mzm^^>m<r>mm<r)— mm** 
■tvi&&m£imizmi ocox ate AtBtctDcom 

7 3 1 li. tffi«B«£«a7>-»# . 
At BtCtDtOff»ftfls!2^g?3 2(i. AfcBhCi 

tBtct Dcommwm?-fm ; %m&3 3«. a«a 

«-f-?i£»SSI»«3 7£*i-U AhBfcCfcDcoS 
^SB 3 8 T'^-T * . AhBiCfcD W«iafiflj*atT 

gP3 2*^^«E(aatjiff^(S]ttfgT^i^^g^ 

ix(fSl^i£^(*cojttff^r6i{c*>-S.^A, b. c, 
ttzte D<D&$kmmftm?tttom w^ms* 3 4 tansm 

$13 6£:ft-L^<0i , £)Ifirt&. A. B. Ci/diDO 
SK»Eaft*3& t »««riEKHIrtt:A-5 T < h b . if 

b«t - 9 m^mmmm 3 7 iciiftiajg z -ft l % <o g % 
mm-&> iimmmmzx vfommizmmx-z. s» 

[0042] ±ie*i6c0ff^«OB*^^i^(i. * y h 

So 

[0043] 8HftB«T-^iS«<I»3 3 fc&liattffc 
jtff^ffiltSffiil/SfSSI 3 5 / 3 6 am 1 0 <7) J: o tc . 

fc -r & t . mmm&m&mft iz$> & b cosa*? * 5 3 

«ff 2s 3 3 *>TR 0 jA^iittiBlix- *i£gfl*y WSB 3 7 

LBfi&^ss 3 8 Sr-r h . o ro&naiarffr 

fatPSiM«25 3 4 *»<5>C<0»iafl»«cJitT*|6lfll«S« 
253 5{Cjifl0H3 6^^-L. ISI£a%f*:c031fi{5at 
«ff}Tfaffiffi£iMSfi-r-2> fc . B J; *) httfinlAltW 

ffigmpttzh&cnmm*}* 7 3 1 frbwrnmnmr- 

9l,ZttL. C<7)lg<£B<I-r- 9m%tE2s 3 3 )WR 0 a* 
»£B<»x-?ilt§ft$WgB3 7 S^-LB««*»3 8 

(0044) CO^BJtcraii-r'S.ffi^tg^-^ffi?:^ 
t-«!«l£asa(ill 11 (a) OXolz. EStf* 5 4 



«. m.m*}*?4 i^sa-t^-9-4 1 a*^6DA^w# 

t=**U BttUOSMfciEHL «tt«*l$. 5a.iS*>±#& 

4 3(1 OT££$flHR <Jfci£tfH«4>3&fc«!ffl. «n 
$ =Sr £ ) fc «t 3 f£«Oi*«IPJ$t&3:fr£ W>1£5£^- 
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